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ABSTRACT 



Systems i.:.i ;;uli:- ds -r... . ;.:i.:;. hoCLsea: t.'ae- r '.'. -dm 

communication channels in classes, of service that do uot 
normally support these types of channels. In one embodi- 
ment, a. method comprises receiving one or more frames, 
wherein each frame contains non-QoS header information, 
classifying the on« or more frames t\- t M*i ..m :>.«• correspond- 
ing aon-QcS header information and scheduling delivery of 
the one or more frames based i.poii cnuttspuiKling ft sine 
class;;; .-..dors, wherem frames :r; t \<<-ii.::-iu^ corrcspoial- 
ing U> QoS circiits -ne sdn--dukd in a manner that meets 
QoS requirements associated -with the QoS circuits. When 
trie frames ate e'.assitivd, they arc .'*>rwanlc<J to dynamically 
allocated queues cor rcss.-oarfiog to the respective ehssihcri- 
lions. Frames are scheduled fot delivery from the queues 
,>vVCfdit:-„» to :• i:ic":!;f;ec: hm-f.!;.i>!> algorithm that is designed 
lo meet the QoS requirement* of the respective circuits This 
method may be implemented, for example, in a Fibre 
Chatm.st Class 2 or Class 3 fabric. 
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SYSTEMS AND METHODS FOR PROVIDING 
QUALITY Or SERVICE fQOS) IN AN 
ftNVI'RON'M knt that does not normally 
SUPPORT QOS FEATURES 

RELATED APPLICATIONS 

[0GO : It i eiaimspnor < s 1' is ion 

1 ! At i > i " ed. '-Method At 
\pp, r i, I > n i \fh; h, fu re u r " 

A Fibre Channel System," by Gary C. Warden, ct a!„ tiled 
Apr. V. 2U02, which is fully kaeorpor.aied by reference as, if 
set forth in its entirety herein. 

BACKGROUND 
[00(12} 1. Pick! Of The Invention 

[0003] This, .invention relates generally ro data cnmaiiurii- 

s and , ' t • is and mc 

imp i -, hag jualiiy of service {e.g., minimum b»«h 1 
and maximum latency guarantees) in environments (e.g.. 
Fibre Chancci Class 2 atiti Class- 3 services) that do not 
normally support quality of sen- ice features 
[0004] ?.. Related Art 

i Off, i ] i n ] r is ( fleet iv 

"device-.") gnrmlL in a.! a! ' is ,-c i Lliill|,l(IO 
channel that allows coininuiiiosi.rem with other devices. 
Communications between devices may be carried over vari- 
olas types of coram umcation channels, such as Fibre Chan- 
ii i si hing id its While U , u ire i ppl 

cable lo other types of communication channels. Fibre 

i i 1 t , i i ii in 

art and e rev ion g - ei • > wjded b> tic embodi- 
ment «f die invention. 

[0006] A .'fibre Channel switching fabric may provide cue 
i i i i i i i 1 

f service p «ss<fi) i r re n rer 

For example, Fibre Channel Class i provides point- to-point 
(ions bew j levicc.fi n» connected leviee ^ c 
allocated iOO percent of the communication chaonefs band- 
width. Fibre Channel Classes 2 and 3, on the other band, 
provide connectionless service ManV ddicrent J u„- may 
he connected by a Fibre Channel fabric that provides Class 

2 or Class 3 scrvi but none f If ( i s res gu 

, r lar ai ml ot out f ibre Clt 1 

I I ! , j 1 Ct " c I 

(he devices thai co.mmurricale via the virtual connection. 
[1MJ07] While the Fibre Channel classes of service provide 
\ s es i iYcrerii types oi 

i i, each has its d s am; ie f ibre 

Channel lass JL \vh 1 t ■ o . lions i ween 
i i t i i ta 

are dedicated to the connection and may not be used for 

ii I i in i 

v i ion 1 i (el I. Class 1 is, therefore, 
rarely used, 

<M)Q8] I ' it >ro< d ss2 r 

ass ? ssrvict i ■ i i uannel will not bloi 

it hanc.ci > t 1 oth 

v ord i, they do aot have switches that arc dcdican ; to 



ii, 1 1 i c i mi Js, 'the do t block 

each f t si i ( 1 1 i how e iat ' 

allocate a portion oi the available baniiwidt.il to eommuni- 
i n be is p-aniciij ' t i mot pr ie nn> 
i 1 1th or la icy oi v h i turd t 
t over tl - espondiiig ebamii a ueii hey 

re no table for tran ou ems oi nidus oi rideu or other 
. S 1 . mgorrt |-timir data hat have ! be delivered 
in a timely manner. Class 2 and Class 3 arc the prevalent 
classes of strvtce in Fibre Channel fabrics. 

[fJtMIJt] Fibre Channel Class 4 establishes virtual amnec 
lions between devices and provides guarantees a.s to lire 
i ' dp nd latency < nicabon er ihr intra 

coiinee'Liotis. Class 4 service can be used to provide frae- 
lio-n.rt bandwidth circuits tilaE allocate a (""action of tire tola! 
oil ' , , ■ . j ' i i .j. nt nn ion Mil! 

rlt us lo this virtual comic tion. Clares 4 is therefore 
capable nf providing service thai is suitable for use in 

liuaiantees. Fibre Channel Class 4, bowev.-.r, reqifires special 
Start-of-Fwme (SoF) delimiters lhal identify the corre- 
sponding QoS i tton and k t (litres, (he active paj- 
tic ion of the mmcatingd c s in order set up 
the virtual connection. The devices have to be able to 
provide the specialized SoF delimiters, headers and other 
information required to set up the end-to-end vicinal con- 
nceiions. Because of these requirements. Class 4 is widely 
considered to ire impractical, and consequently has not been 
implemented. 

£0014]. Despite the various capabilities that are provided 

I i fividua ' 1 v i 

not a class, of service that is currently available that is both 

0 i it ( ' j t i 
n t - that requires band 1 

gi u races M 'rcovcr, there t- not a class oi service thai is 
available or even defined that enables these requirements to 
be met for legacy devices (e.g., Fibre Channel Class 2 and 
3 devices). 

SUMMARY OF 'HIE INVENTION 

PHI] One or more of the problems -outlined above may 
be solved by the various embodiments of the invention, 
it / spc ' t'h i lion comprises systems i 

1 I [ 1 1 ii n t >t t » I 
hareaeis i esses c! i on illy - rt 

<> v i >f ct El si i be a led thai while the 

i r i ! i > i i i i 

■ii Fibre Cham 1 i sy.slei 

ie systems arid methoe . » icabi 
it, dilhrcnlt i ao, ml - h rid 1 ' ...nsiocd <o 

ide embc > «ed in non-Pi 

Channel environments. 

[00.12] I 1 i nil ii 

i< t 1 r r H ( s 

mation fyi.ng tic one or m u frai ics 

I c coi littg t OoS I i ii nation 

ant! scheduling delivery of the one or more frames hsscd 
pi .-orrcspoi r me cias ific ii or re mc ■' 
el h i ling to QoS -circuits are scl ' ' 

iii ' j i ' 

QoS circuits. When the frames arc classified, ihey arc 
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! respective 1, s ti 1 if i are scheduled 

debvci frt, > the queu. ceo dins; i a • ilied i. 
jU i! 1,1 f ed ! M . O S ,< I c all ' 

m < ircuils. "! i] ) 1' ,, • ' i 

for example, hi a Fibre- Channel Class 2 or Class 3 fabric. 

[0013] An )lh r trot i e nj itch ha' 

one or more input pons, one or more output ports, one or 

re queues and a pi It i 

tripti! or tin. h , en *nsj I i j > ad is co 
UK i* to ii! i s i ii it r ved at lit 

input ports, classify the frames based on corresponding 
non-QoS header information, and schedule. iiansmthsioH of 
iSxe frames based e>n ihc respective classifications of she 
frames from llie output ports. The switch may include a 
decision buffer in which frames are stored and examined 
before being classified by the processor and forwarded to atl 
i priau queue fhe switch maj Iso inclntk a deep 
buffer for receiving burses of frames and storing I hero until 
i i: be classified ana! I £ 1 Ifie pro quwn 

The queues, .may fie dynamically allocated (e.g. as linked 
lists) from a po«-l ■>! butler spaee. A pSciak.v ot liie^e 

j i 'ii ecmbit homoge . s 
neously, to form a fabric thai supports end-to-end QoS. 

( t 1 1 ' t> i i i i) i o 

sib le. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[WIS] Other objects and advantages of ihc invention rnay 
become apparent upon reading ih foil vmg t «, ! 
description and upon relerence io the accompanying draw- 

[0016] FIG. 1 is a flow diagram ill usixn ling a method in 
accordance wills one embodiment of the invention. 



[0017] FIG. 3 is » diagram illustrati 




[0019] FIG. 4 is a diagram illustrating the standard frame 
layout of a Fibre Channel frame. 

[0020] HG. 5 is a or ra ilb ! rating an t gloried view 
1 frame. 

[0021] FIG. 6 is » diagram illustrating a host computer 

•le transmit numerating \ i swik 

f Port having i broalitj ,) h>nnmi< i co queues. 

[0022] I If ' t te t i II MniTiiH ait, ii tr- 
,j a > \ lehii , 1 leivveen a first device, \, io a 
second device, C. 

[00231 While the invention is subject to various modil'i- 
ions and altern . i the en . s tber 

i howii be va o! example is n, the 

nying d m h should i 

v it I i i eseriplioii are 

• no itiblcm itl '* f it 1 1 • i . « i 

1 . - s instead miendee 



v i nts and alternatives . fa!! 

within she sc [e th prest t ii ,0 1 by tit 

i, ded e jrns 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

[0024] One or more preferred embodiment* of the invcro 
iion ate t r below. It should be i d I id 
any olhi r etnbi c 1 ••• ».-. -a r : • . I 

are intended to be illustrative of (be invention .rather than 
limiting. 

[0025] Broadly speskang, (tie invention comprises systems 

1 f v l i i tit 

cation channels in classes of service that do not normally 
!> I i i i t t si cm 1 x i etc 1 that, 

a lint the p i 1 1 i a j , , i , 1 | irtip 

r nte i i lit m.d ( lac 3 

systems, ihe systems and methods dbaiosed herein are 
applicable to many different emvironmcms, and should he 
< btruetl lo i . i > KjimciUs !i it ire. implemented in 
non-Fibre Channel environments. 

[0026] In one embodiment, a method implemented in a 
Fibre Ch mm I Class 2 or Class 3 fabric < uprises. clt ssil ■ 
ing the Class ,2 or Class 3 (liort-QoS) frames using infor- 
mation in existing headers, queiicing ihe classified frames 
ind scheduling dm dt !' ihe queued frat , meet th 

bandwidth ami latency requirement* ot particular virtual 
connections between devices. This -method is illustrated ia 
the How diagram of FIG. 1. 

[0027] flits embodiment, t i ,. - i 

u itched fabri gy. Tf 1 fabric ma 

configured to provide either fibre Channel Class 2 or Fibre 
Channel Class 3 service. The switched fabric include.* one or 
more switches that arc designed to operate in accordance 
with the pit j. 1 i * r 1 

by e; ! oi (b( so swatch tlte frames are first classified s 
that the frames which are io be handled with a particular 
quality ol ma. ire ie-grci; ted Che frames are , I 
based on information that is present in headers thai are 
normal! use > i t vithC -2 rt! ,3 crviee. 
For example, the classi.hcatton may be based on the somce 
and destination device identifiem, and/or any other informa- 
tion if] the frame headers. 

[0028] In this embodiment, when each frame is classified, 
it is forwarded to a queue to await traasn.iis.siDn. Each queue 

i , ponclin 

tion chauaci. The frames are removed from the queue and 

,1 r I I tl I i lie i l 

i - ^ wa;, on ■ he mi sin m > , ..if. md 

r , i I i r iri'iiiy of serene ssr 
elated with the channel. 

[0029] The frames are removed from the queue* and 
transmitted as determined by a scheduling algorithm. In ibis 
mbodimeni, ih , i gondii ' h'lied 

bin-Tiling algorithm. In this algorithm, the lot.i.l available 
bandwtdtt aruttoned ■ ! nun - 

i td one mrix'imii! 

size Fibre Channel frame, the reserved bandwidth for a 
particular viriuai con is equi lent > • ■ o i 

i fi ta! Dumt f bias. The bins thai 
to virtual connections arc filled first with frames coi resporid- 



US 2003/0189935 A i. 



3 



Oct 2003 



ing to (he respective virtual connections. After ail virtual 
circuits have been satisfied, the rcrrsammg space in the bins 
is tilled vvilh any other frames thai are available for for- 
warding. "The scheduling algorithm is thereby able to 
achieve I0(i pcic.-ni :.:.':i/a:i..-n of the av.uiable bandwidth, 
ivcr. -\ i. !>; i::-.a::.:eis ;;:ivl;:j: rested b::::.:- 

width do not use ail of their allocated bandwidth, 

[1)030) One embodiment of the present invention is 
directed lo s method or apparatus for isjpleir.tnting QcS 

feature;; in ;| : i •;■ r ■ ; . [ . . ic,;.:. ■■; d .-n:,::. bttwccil .t f.f.s: itv. see 

and a second device through at least one .switch. 'Ibis is 
achieved by allocating and operating fractional bandwidth 
eire-uiis thai satisfy requirc-mooes oi riutnmui:: guaranteed 
bandwidth, maximum guaranteed latency, and guaranteed 
delivery <">; connectionless inform s:i •.: between the 

first and second de.vu:es. w hicll st-pr.Ott 3ild ptutciptJiv iiSe 

the ..on-fractional fibre Channel Classes of .Service 2 or 3 to 
communicate. 

[0031] One embodiment is further directed so :• method or 
apparatus for deallocating fractional bandwidth circuits in a 
fibre Channel .system when they are no longer needed. This 
embodiment may further be configured to ccrnovc fractional 
bandwidth circuits when an error is detected. 

[0032] One embodiment is further directed to a method or 
apparatus lot making available bandwidth that is not allo- 
cau-d u.! fractional bandwidth circuits, i.e., liie unused avai;- 
abie bandwidth, available for use by non-fractional infor- 
mation frames in Fibre Channel Classes of Service 2 or 3 
between a different pair of devices or device ports. 

[0033] One. embodiment relates to a method or apparatus 
for the switched fabric topology and the legacy devices 
i-.mpkd tlw.-reb., lot alloc»tim», operating. dea:!cvatin« and 
removing fractional bandwidth circuits for non-fractional 
Classes of Service with,;-;; .diar:-:< ; ' ire legacy devices One 
embodiment relates to a method or apparatus to permit 
legacy devices that use me switched fabric topology arid that 
implement either Class 2 or Class 3. or both, io receive Ihe 
beiit u - ->f f!:!C'i! .ti,:! >.•::: i.M.hh cnvn-l- without i . ,.h s-gn 
or replacement of the current legacy devices. 

[0034} Further, one embodiment is directed to a method or 
apparatus that permits reducing the cost and complexity of 
a system while meeting the needs of these example appli- 
cations and others. 

[0035] Definitions 

[0036] Before describing i"c pre 'erred embodiment in 
detail, it may be helpful to review some of the terms used in 
relation to this embodiment, ft should he noted tint many of 
;h.: i irh ,-,;<, :>•:■■, oelo-.v :;: r i \:i..r ■. w ro.e, I i7..v/r; or corded tVoiW 
the NOITS TI I group's working draft standard propose;; to 
the American National standard fcr lt.iormau.on Technol- 
ogy; Document titled "Fibre Channel; framing and Signal- 
ing FC-l-S Rev i.70. Clauses and .sections noted in the 
definitions may he found in thai standard. Although the 
de:i::i:;o .s belcw focus on :!r.e f: >.re Chrome'; embodiments 
.1. scribed in detail herein, it should be noted, as explained 
above, ttta: tdiern i'.ivc t-RrbodiniCDis need act be limited to 
Fibre Channel systems. 



[0037] Arrival Time : The lime a frame arrives into a given 

[W38] Bandwidth: The amount of data being sent ov^r 
one side of a Fibre Channel Link in a fixed time period or 
the total capacity of the Jink to contain data. Typically 
measured in bytes per .second (Bps) or Megabytes per 
second (MBps). 

[0039] Classes of service: Type of frame delivery services 
lived by the comrrumie.itir.g NxJ'mis that may also be 
supported through a fabric. (.Sec 4.8 and clause 13.) 
[0040] Class 1 service: A service that establishes a dedi- 
cated esftneoiion between two communicating Nx Pons. 
(See 4.8.2 and 1.3.2.) 

•004,. • ',";.::■.•. » <c.vtcc: A servisv tha: ••>•.:!: i: it ses Ironies 
at frame boundaries to or from one or more Nx Ports with 
acknowledgement provided. (See 4.8.3 and 13 J) 
[0042} Class 3 service: A service that multiplexes frames 
al. frame, boundaries lo or from otic or more NxJPoris 
without ackuowk:Jgeiii<:ut. {.See 4.8 4 and .13 1 ) 
[0043] Class 4 circuit: A pair r;f unidirectional Virtual 
Circuits between two communicating N ..Potts, (see 25.3 5) 
[0044] Class 4 service: A fabric service thai establishes 
Virtual Circuits to provider fractional bandwidth service 
between communicating N_Pons. The fabric service multi- 
plexes fiames at flame boundaries using in-order delivery to 
or from one or more N_Poris with acknowledgment pro- 
vided. (See 4.8.5, 13.6 and clause 25.) 
[0045] Claw Specific Control field : CSCTL is an eight bit 
field containing a Virtual Circuit Identifier (VCJD). 
[0046] Credit: The maximum number of butlers allocated 
at a recipient lo receive frames from a transmitting FCJPwt. 
If represents the maximum number outstanding of frames 
that can be transmitted by an FC_Port without acknowl- 
edgement without causing a buffer overrun condition at the 
receiver. (See 18.3.) 

[0047] Data frame: An FC-4 Device J)aia frame, an FC-4 
VidwDau frame, or a LinkJJata frame. (See clause 11) 
[004S] Desunatioajdentifter (DJD): The address identi- 
fier used to indicate the targeted destination Nx Port of the 
transmitted frame, (see 9.4) 

[004J>] Destination Nx_Port: The Nx_Porl to which a 
frame is targeted. 

[0050] Earliest Deadlmc First: An algorithm that sched- 
ules events to occur irt order of their proximity to a deadline. 
The most critical event is (he one whose time: is closest to 
expiring. 

[0051] Exchange: 'Ihe unit of protocol activity that trans- 
fers information between a specific Origiuator Nx_Port and 
specific Responcer Nx_l'orl using one or more related 
non-concurrent Sequences which may flow in the same or 
opposite directions. The f>:ch?.!.L>e is identified bv an 
OXJD and a RXJ JD. (see elau.se" 17) 
[0052] Expiry Time: The time by which a frame must be 
sent out of a switch tn order :c> meet its latency requirement. 
I: is computed as ihe time when a frame is considered to bo 
eligible for forwarding plus its period. A ft ante is considered, 
c'sigibie tor forwarding when it has actually arrived into the 
fabric input decisicr buffer, been proper:;.' c;as;;:k.i, been 
queued with the proper tags for forwarding to the correct 
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output buffer and a period of time has elapsed since :be 
previous frame itt Hits circuit has been marked asel.gib-c- for 
forwarding, 

[0053] l>. i • The Link Control Facility (LCI } within the 
Fabric thai attaches to an N .Port through a Jink. An FJPorl 
is addressable bv the N Port attached to it, wish a common 
well-known addtcss identifier (hex ' IT FF FE'). See 9,4. 
[0054] Fabric: Trie entity wnicb mtefcoence:.*. N\ _!'o;N 
attached to it and is e ; ; .-oaling !r.:i:i-.-> by using only 

the DJh") information in a PC-2 frame header, (see 4.7.3) 

[0055] Fabric _Namc. A Namcjdentirkr associated with a 
Fabric, (ii^c ciau.se 14 and 15.5.4) 

[0056] Fractional bandwidth: A portion of the total band - 
width available on a path, (see clau.se 25) 
[0057] Fractional Circuit (FC): A unidirectional path 
kiwccsi two eomnunucasmg NJ'ors through a fabric ibot 
permits Cia.ss 2, 3, and/or 4 service to be used. A Fr e cuonal 
Circuit is synonymous with Viitual Circuit. Two 'fraction..! 
Circuits are required to form a Class 4 Circuit. (See 4.8.5 and 
25.3.5.) The existence of a fractional or virtual circuit 
implies Utat the circuit has wane ;;ea: ,.r.!c>.J level of access 
to the available bandwidth of the Fibre Channel links 
forming an end-to-end circuit. Furthermore there may 
optionally be a latency guarantee associated with the frac- 
tional or virtual circuit. 

C005.S| Frame Aii indivisible unit of information used by 
i'C-2, (see S.I) 

[0059] Frame 'nine: The amount of time from when a 
frame -arts leaving a port io when i! finishes leaving a port. 
This could be thought of as the time domain length of a 

frame. 

[0060] HBA: Equivalent to NIC and NxJPort. 
[0061] Latency: The amount of time a frame takes to 
liavcistt the network, plus the lime the frame is available in 
the entry switch for forwarding but is waiting to be for- 
warded. This does not include the time when the frame 
■nt|>ht have been actually received hy the entry switch bid 
was. not available in the respective queue to be forwarded. 
[0062] Link: Two unidirectional fibers transmitting in 
opposite directions and their associated transmitters and 
receivers. A Jilxr may be a copper or optic strand of media. 
[1)063] Live Credit: This is the number of frames that 3 
sender may send one after the other before having to wail for 
additional credit to send. Without live credit, if a sender is 
going to seed frames at a rate of 100 frames per second, it 
■could send 100 frames a! Once and then wait a second before 
sending more or it could send 10 frames every tenth of a 
second or it could send t frame every hundredth of a second. 
Live credit can Iks used to limit this. 

[0064] Local Fx_Port: The Fx_Port to which an NxJ'ort 
is dircctlv attached by a link or an Arbitrated \xx>p (sec 
remote Fxjtwi). 

[0065] FJ'ori: A port that contains Arbitrated Loop func- 
tions associated with Arbitrated Loop topology (See [7], 
FC-AL-2). 

;;0066] Nawejdcntifier. A 64-bit identifier, with a 60-bit 
value preceded •>> .-. 4-bi; Network_Address_ Authority 
identifier, used to identify entities in Fibre Channel (e.g. 



[0067] N_Port., node, FPort, or Fabric.) (see clause 1.4). 

[0068] Network._Address_ Authority (NAA): An organiza- 
tion such as CC!TT or IBB& that administers network 
addresses, (sec ci. i-') 

[0069] Ncilwork_ Address, Authority (NAA) identifier; A 
four-bit idcot i tier defined to indicate a Neiwork_Atkitcs- 
s_Authorily (NAA) (sec clause 14). 

[0070] NIC: A Network Interface Card; this refers to the 
Port that serves as an interface for a Node to the Fibre 
Channel network. A NIC is equivalent to a Nx_Port. 

[0071] NLJ»ort: An NJ'on that contains the Loop Port 
Stale. Machine defined in [7], FC-AL-2. It may t>e attached 
via a link to one or more NL_Porls arid zero or more 
FL_Ports in an Arbitrated loop topology. Without the quali- 
fier "Public" or "Private," an NL_Port is assumed to be a 
Public NLJtort. 

[0072] Node: A collection of one or more Nx_Ports con- 
trolled by a level above PC-2. (see 4.1) 

[0073] Node„Namc: A Namejtlentifier associated with a 

[0074] Non-QoS: A system, method, etc. that does not 
h.o\ ()oS (Quality of Service) characteristics. For example, 
a nori-0o$ frame is one that is not designed specifically to 
provide QoS or be used in a QoS system. A Fibre Channel 
Class 2 or Class 3 frame is a noti-QoS frame and has 
noct-QoS header information. 

[0075] N_Port: A hardware entity that includes a LCF, It 
may act as an Originator, a Respondcr, or both, (see 4.1) 
Well-known addresses are also considered to be N Ports 
(soc 9.4.2). 

[0076] N_Port_lD: A Fabric unique address ideutilier by 
wliich an N_Por7is known. The identifier may be assigned 
by tile fabric during tt:e mubh./ation piocedwte oi by .uhct 
pro-ccures cot defined in this standard. Hie identifier is used 
in the SJD and DJD fiekts of a frame, (see 9,4) 

[0077] N Port Name: A Name Identifier associated with 
an N_Port. (See clause 14 and 15.5.3) 

[007S] Nx Port: A port capable of op era ting as an N Port 
or NL_Port, but not as an L_Port. (See [7], FC-AL-2?) 

[0079] Origuutot: The logical function associated with an 
Nx_Pott responsible to: originating an Exchange. 

[0080] Paylosd: Contents of the Data Field of a frame, 
excluding Optional Headers and till bytes, if present (see 
table 12, and clause 8, clause 10, and ! 1 I ) 

[ttOtii] Period: The. amount of time that if frames for a 
circuit are sent everv "period" time they will cxacilv achieve 
their desired bandwidth. 

[0082] Primitive Signal: A special Fibre Channel word 
consisting of four bytes. The ttrs; byte is always a K28.S 
character which is a bit combination that is impossible to 
duplicate in valid data and which can easily be detected in 
hardware receiver logic. The trite i: remaining bytes of the 
word are formed to indicate different primitive signals. 
IT;-:: five signals are used in fibre Channel to do m-band 
link level control functions like How control. 
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(0083] QoS: Quality of Service. Providing QoS mean* 
pioviding OoS guarantees, such minimum bandwidth or 
maximum latency in (he- delivery of frames. 
[00841 R_RDY: A primitive signal thai, is used as a token 
for piivsic-ii buffet -to-buffct How control. A port utilizing 
BuJfer-to-Buffcr Hew control mav only originate a frame on 
She link if tts BB_Cfcd:! (Uu»ct-h~Ht:..--..f e:;-;1:!)<.r. the link 
is greater than zero. Once the frame, is sent the BBCrcdit 
count is deer (.-merited by one. A receiving port indicates a 
physical buffet' is available by sending lbs R_RDY primitive 

[0085] Remote FxJ'orl: The FxJ'orl to which the other 
comimiitieatina Nx_Por( is dirtctlv attached (see local 
FxJPorl) 

[0080] Responder: The logical function in an Nx_l J ori 
responsible lot supporting the Exchange initialed by the 
Originator [i, .hi >tl ic ; N\_Poir 

[0087] Sequence: A set of one or mote Data frames with 
» common Sequence J I.) (M.Q.JO), tt:msmitu.d unidircc- 
tionaliy from one Nx_Porl to another Nx_Port with a 
corresponding response, if applicable, transmitted in 
response to each Data frame, (sec clause .17), 
£0088] SequerieeJD (SBQJD): An eight bit field that 
contain?, a tag that all frames within that sequence of frames 
will carry showing that they are identified as part of she same 

[0089] Sequence Initiator: The Nx^Port that initiates a 
Sequence :it«! transmits Data frames to the destination 
Nx_Port (sea clause 1.7). 

[0090] Sequence Recipient: The Nx_Port which receives 
Data frames iWw ihe Scqi.er.cc. Irtiu.iior ai.d, if applicable, 
transmits responses (i.e. Unk_Conttol frames) to the 
Sequence Initiator (see clause 17). 

[0091] Simple Network Management Protocol: A protocol 
lor CMiituiBtuc.iitiij' '•>■■:'■■ i> so.uctw .\; «i.ii;8f.e.(ic;« iuforina 
iiori. il is in wide use in versions 1 and 2 See : 23], RFC 115" 
for version 1 or [24], RFC 1901 for version 2. 

[0092] Souree_idcmiiier (SJQf. Hie address identilier 
used to Indicate the source Nx For: of the transmitted i'l am- 

[0093] Source NxPort: The Nx_Port from which a frame 
is transmitted. 

[0094] TYPE: An eight bit field in the Fibre Channel 
frame header that indicates 'he upper revel protocol or Basic 
Link service the frame belongs to. 

[0005] Virtual Circuit (VC): A unidirectional path between 
two .' ay : m;:mc.i.;'a.-. N Paris 'hou:.'" a fahrv ;ha: permits 
Class 2, 3, and/or 4 service to be used. A Fractional Circuit 
is synonvmous with Virtual Circuit. Two Virtual Circuits are 
required' to form a Class 4 Circuit. (See 4.8.5 and 25.3.5.) 
[0096] Virtual Circuit Credit (VC Credit): The number of 
receiver buffers allocated to a Virtual Circuit by an FPorl. 
1; represents the maximum number of frames that an N_Port 
m.:V •.ransm.it without causing a buffer overrun condition at 
ihe>_Port receiver (See 13.6 and clause 25) 

[0097] Virtual Circuit Identifier (VCJD): An identifier 
ass,eia;ed with e::ber :ha Originator (OVCJD) or 
Responder (RV'CJD) for a Virtual Circuit .(see 9.5.2) 



[0098] Virtual path: A iixed route through a Fabric in 
support of a Virtual Circuit. 

[009<*] Well-known addresses: A set of address identifiers 
denna: in this : ,: 3 ndard to access global server functions, 
(e.g. a name server) (see 9.4). 

[0100] Word: A string of four contiguous bytes occurring 
on boundaries that are. zero modulo 4 from a specified 

[0101] Worldwide_Name: A Name_ldcn!ifier which is 
xvoiklwkie (globally) unique, and represented by a 64-bit 

value, (see clause 14) 

[0102] Preferred Embodiments 

[0103] Referring to Fl<». 2, a diagram illustrating a stor- 
age area network (SAN) is shown, lite SAN comprises one 
or more devices 12 that serve as end nodes for transactions 
on the SAN. Each of devices 12 is connected to a switching 
FYnnc 14. In one > tn nid.ir.ect, .wvjwhinp, fabric 14 comprises 
a Fibre Channel fabric. The Fibre Channel fabric may 
comprise one or more fiore < latiiti switches lite switches 
may be interconnected according to a variety o! djfleresti 
topologies, and may form a plurality of paths for Fibre 
Channel frames to traverse the fabric from one device to 
another. 

[0104] It should be noted that, for the purposes of this 
discfrsure, identical items in the figures may be indicated by 
identical teferencc numetais followed by a lowercase ictu.-i. 
e.g., 12«, 126, and so on. The items may be collectively 
referred to herein simply by the reference numeral. 

[0105] Referring to FIG. 3, a functional block diagram 
illustrating the structure of an exemplary switch in accor- 
dance with one embodiment of the invention is shown. In 
this embodiment, switch 20 comprises a Fibre. Channel 
switch. Switch 20 includes an 

[0106] input port 22 through which Fibre Channel frames 
are received and a pairoi output ports 24 from which fra;iies 
are forwarded to other nodes (e.g.. other switches or end- 
node devices) Switch 20 incorporates a processor 26 for 
controlling the routing of frames to the appropriate destina- 
tions. Processor 26 may include any type of data processing 
device, mciueir.g a ahcropfocessoi, FTC A, ASIC or the like 
which is capable of performing the functions described 
herein. 

[01071 Switch 20 also includes a decision buffer 2S and a 
set of dynamic queues 30. Frames that are received via input 
r •it 22 lie forwirrvd So decision -«::Ter 2$. When the Sn-adei 
information for the frame :e:.e:r.s ;'-.'.o..oij -miler 2H. pro- 
cessor 2ft examines -he header uJcrno: :. ai. Be ad spur, ai 
least a porlionof this information, •.-•ovi 2''* cias- aloe the 
!': : i. -e .file, frame may i.v oh-cTa. I a,\ bem". '• ■ a aeie-' wiiji 

a OoS circuit, or it may be classified as normal fibre 
Channel Class 2 or Class 3 traffic. Based upon the elassili- 
cation, the frame is sent to an appropriate queue within the 
set of queues 30. 

[0108] In one embodiment, queues 30 actually comprise a 
pool of buffer space Th.es buffer space 1. dynamically 
allocated to various queues as the space is needed, in fact, 
the queues themselves may he allocated a.ad clesli'eeated as 
needed. Eaeb of the queues is associated a QoS circuit, 
except for One queue that handles the normal Class 2 or 
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Ci3ss 3 frames ramc la it - ice! as traffic for a 

1 t i rOoS i ei l i orwarded to the queue orrespond- 
ing to shat circuit. If ;i frame is mil associated with a 

i L led u the pa in; t the 

normal Class 2 or Class 3 frames. Thus, alt of the frames 
stored in a particular queue are associated will) Iter same 
level of QbS (i.e., either the same QoS circuit or the same 
> iss 2/3 sen, c) and lohcciu! ' a , i , i . ■ , in 

jt!H>')i l; y p o . QoS requirements for • par,, . 
QoS citcv.it, processor 26 schedules the transmission of 
frames in the corresponding queue. If a QoS circuit is 
;moi'i al N mom per second of bandwidth, processor 26 
les a leasl N frames from nc o responding queu 
foi urmsmis: ion lo die eat node in the respective t 

i n i eci with normal Class 

2 or Class 3 service ate scheduled for transmission as 

i i iVh i sd I he 

■ 'i its quel tppiopriate 
one of output pods 24. 

[0115)] "hire Fibre Channel Classes of Service described 
herein (i.e., Classes 1-4, 6 and F) are described in detail ha 
several standards documents ihat are. publicly available. 
Several oE t ' ien ar dt tificd it he end of this 
(JiSiiki un and itt i n b; reference. 

[0111] In a Fibre Chitond ehv&bnnieni, the commumcal- 
ifBjo, devices arc called nodes, as contrasted with switches and 
.Cabs tu ! e iap!. node:, ttigctiuci 1 bre ( hat nel p i 

, i tehed t on uni i (an t tli 

11 i i th« i a i 
channel. 'Fibre Channel supports the pi evident network 
■ environment deployed today, as well as traditional I/O 

1 ral ww lor .storage devices this n ires it possible to use 
one communication channel in a device to support both 

I ' 1 l i to itoct i 

0152] 1 l , n Pi 

winch i set oJ devices m x p u i'bes , >i 
include, lor example, a direct one-to-one coupling between 
two devices (called point-to-point), a loop topology, and a 
itched fabric topol witch ic pi t i 

.ie i ni d lies I ui ' i, 

o! devi , wit! .ul estri i as to lie mat nei m 
ich th he i i e , nd i to the tnsnne , t 

winch the devices are coupled to the network. 



[01.13] 


White Fibre Channel has man} 




hoc - i 


tl it'll! 


e Channel supports 




•cm Classes of Service for delivt 


;rmg, or attempting 


to deliv 


er, information frames bocw,;> 


en communtcrttir.g 




or sv i i 1 th .i >w 


niches in a system. 


I e i 1 


, se! e m,o!ide< 1 i,v 


1-4, 6 and F s which 




Je scribed in more detail below. 


Neither these , nor 



any of the other Classes of Service for Fibre Channel 

noil I J ( 1 

circuits rbere are, however, man; pp! Hi > thai requ 
! 1 ' ' Si tor that cannot be alter I 

iw idiJ ed to rn h< lire I 1 i maple, st .rage 

i I audio strean in 

>aei i ' }oS g i, i t provit 

ii h QoS t ih' 

ttre not met, or they are-i^l : %'OV6r^r^mb]3it^-^--&yaem-,, 



( -p niDg l «d here io i fer to ! e iui m in 

which devices, ports and switches are dedicated to the 
syste n so thai there is m congestion that would otherv ist 
t h m i 1 i tron a; using a non- 

iraetionsl Class of Service The over-provisioning n! the 
system is a "brute-force'' method dial is inefficient and 

v 1 r ! 1(1 r ! 

for QoS behavior, it docs so only by using specially designed 
devices arid switches. To implement Class 4, all legacy 
devices would have to be pi n r; ipleteiy redesigned 
to add the Class 4 service. As a result. Class 4 is not a viable 
option and has never been deployed. 

[0114] 1 in 'tie Idi tol Her ( 1) an biw itsm.., 
a typical prior art PC switch would receive a frame of data 
from a NIC <u id ii to jnesl . ■ ni] 

no concept of guarsnh II nidi r lenc AFC switch 

is used to provide paths between Ni'. ■ Data is sent along 

s ! , ees of j'rai 1 i t m a 

hea pa ! data. Ti ider ; les routing u 

relation tor the frame. Ciis information mchides\s ID, 
D_ID ( s_i 5 rYP u SEQJD Mulipl.tr n 
up a FC scqu on tnd nn ii p equcttees make up a FC 
Eschange. A NIC may have multiple exchanges and 
sequences acuvc at any time, lull will send frames to the 
switch one al a time, blow control between a NIC and switch 
is controlled by link credit. A link credit of one means that 
the port can send one ft ante, a link credit of two means the 
port can send t ran s. single ii b 
when a frame is sent. Link credit is gained when a port 

eceives R kit"! prirni it oil, A R_RD 

t ia (he s i ha he Fame I 1 i t 

r« NIC base mi t t ben our,. t ' 
buffet. 

[0115] Thus, in normal class 2 and class 3 service, the 
fibre Channel frames arc simply sent from the NIC to the 
fibre Channel switch one at a time, with each frame being 
ivmled by the switch as it is received. Each of die frames is 
ban led in it s r runner, ft! the pr i i it 
meli j hi vveveu he 1 ante > may bo handled di£ , 
depending upon the cornmunicaiinn channel over which 
they will be sent and whether QoS features are provided in 
that channel. The QoS features are provided through the 
} t i "j i , 

into three fundsratiilaf components: (1) frame classification; 
(2) frame queuing, and (3) dame scheduling, each of will ire 
discussed in turn below 
[01161 Frame Classification 

[0117] fn one embodiment, all switches perform frame 
classification. Typical prior art fibre Channel switches 

mine Ihc frame > pull ol e. desti n addr 

of the frame and then perform ., table lookup (in a routing 
t a ie) tc d t n use when lo re utc die frame In die u . . nt 
systems and i ods, i n n addr r > r t 

is still determined, but the frame is classified as well. More 
0 Like dK n ii il d m 1 I l ' i 

> in ir not h i is a QoS r am tie e is.- s n 
• must determine will i i s tional ci M 
i i I , ii i. 'mi 

lion of the contents of inc. frame and lookup in a cla.ssih- 

ion ta? 1 noil- QoS 'ii i 

giOiin and que ted togethc! 

[0.I1S] i e nb dim the i 1 (S JD 

' uionjd (D_ID) are used for the das Ikati f QoS 
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frames. These two fields were chosen in this embodiment 
because, since these fields are loaned iu ihe first two words 
of the header of the frame, the ciass-lficatiots process still 
:J!oc,s • lil-l.hioagh ; : at. or. \<-i>t» s'ore aid tor-Verd x-iit • 
ing. Further, using these two fields allows a virtually unlim- 
ited number of fractional circuits (2""} per mps't port Sf.'J 
further, or.:.: i;s-.,. fax. be his :xoa:;'os no ';io:.htic..iic; ; o; lf;c 
frame by Hie source or destination node device. as«:nip;u«:d 
loth.. :'«!i»:es :.scii oi sra-nUrd shxs2 o; class j c-er. .c, in 
(hi.s embodiment, however, the classification table used to 
compare SJD-OJD pairs and >c thereby classify the frames 
must he set up prior So the arrival of the first QoS frame. 
[01 U>] The classification of frames begins with the arrival 
oi' the frames o : >i; u:;-i:i i.,-,s md sunae ot the .ra:r,c« i.I 
a decision buffer. Al'kst at least a por.,ct: of a fiarao (i.e., the 
header) is stored in the decision butler, this portion of the 
frame can be examined to ideniify inferrr alion thai is used 
to classify the frame. Based upon she idemkied information 
(e.g., SJD and DJD). a routing decision is made and the 
frame is routed to the appropriate transmitting buffer, or 
queue. The routing decision may be made before the entire 
frame has actually entered the decision butter. This is called 
cut-through routing. 

[0120] In one embodiment, the switch uses the routing 
protocol defined in the Fibre Channel Standards (FSl'F or 
Fabric Shortest Path First). To support packet switching 
(e.g., Fibre Channel Class 2 and Class 3), iianies must be 
route:.! according to the destination identifier (DJD) of the 
packet or frame. For lite standard frame layout see FIG. 4. 
For (lie exploded view of the frame beadet see FIG. 5. 
lypical for Fibre Channel switches is "domain'' routing. 
'Domain" refers to the most significant byte of the 24 bit 
native f ibre Channel address thai comprises I iu: OjD of the 
frame. During system setup, each fabric domain controller 
takes one domain address. 

[0121] Referring Jo H1G. 4, the Startof-Frame (SoF) 
ilctiiiiilci is a .specially encoded Hi bit byte character olh- 
envise known as an Ordered Set that uniquely identifies the 
start of frames. Each class of service in Fibre Channel has 
its own special Sol dclin.ker. This Is how fabit. switches 
and ports launv when frames an- arrivinc ;•'(■:' ese.npie th. re 
ts ;, Soft. S. 1 Sol-. Sofa, nut SoF: •<•; Use tie:.; ! 
classes »>f service. Tile F.iioi- oi -Fr r.;. ; e ;!.oF) deoo.itei is , 
sjiecutly ene.Kied 10 lit Pvt. character i-euericaliv know-: s; . 
an Ordered Set that uniquely identifies the end of a frame. 
Unlike the Sol the FoF docs no! .'ndicate a Fibre Channel 
class of service. The header is 24 bytes and contains numer- 
ous lields used for frame fouling and for controlling the 
exchange of data between two ports. The pay load Ifidd 
contains, the ,-J.>:r. thr-.l i< bcim*. sent oi received, ffcc payioa.i 
may be any size from zero bytes up to ana ir.e.udtnc 211.2 
byi'es. Hie Cyclic Redundancy Cheek is a four byte field that 
is us, .! u, check : hr i:oe;;.- ; .',y :'::e pr.xic.i.na frame 

[0122] In one emiHidirncnt, the SJD of the frame Ls used 
in addition to ihe DJD to classify the frame. Any of the 
fields of the Fibre Channel frame header could be used and 
the frame still be out- through routed. See FIC. 5. In one 
embodiment, SJD, DJD, CS_CTL, and TYPE fields arc 
used to classify and route frames. 

[0123] In Fibre Channel, alias addresses are allowed |o be 
s _r i u, ■ } ) V tti - i h there is a definition for 
virtual. N J'orts that allows a single physical N_l ! ort to have 



any number oi v:rti;:i! NJ'ori address, sei'tairsts f;.*m .he 
fabric. The eflecl is la allow specific applications behind an 
NJFert to bote ••r.h.Js 24 bit native Ftorc ( tf,n;,.. i .:et,hcsscs 
as their {tsseriaiee Fitter- Channel NJ?ofl's SJD. There tor. . 
pert'c'.-rrtng frame classitieatioit based on both the SJD and 
the DJD allows ;neiv;dea! ;,pp!ications to reserve fractional 
id-.vedth circuits. Trie other fields allow various levels of 
groupings of applications for more robust and varied frame 
i ! cssrioetioi; Any of these tide's car he used lor the purpose 
of frame classiiie;.;:on as disclosed herein. 
[0124] Embodimetiis of the present invention use header 
fields (typically other than the D ID field) during frame 
classification for Ihe purpose of establishing and enabling 
end-to-tmd QoS connections. This may provide distinct 
advantages over the prior art. It is also distinct from methods 
rfccumeatt'tl in Ihe prior art such as Fibre Channel Class 4 
methods, which include no frame classification but simply 
perform noni.ai exim./iat.on of DJD for routing decisions, 
fumes ate eiassifioo. a; Class 4 •>> use poseur, ol a Special 
Ordered Set for Start -of-Framc Class 4 (SOI-4). This Class 
4 SOP delimiter precedes the frame and is uniquely coded so 
that liiaic may be ttipgevd on the teeogmtiou of the appro- 
priate bit paliera that a QoS Class 4 frame has arrived. 
Further classification in Class 4 is completed by the use of 
the CS_CTL field where the specific Fractional circuit is 
identified. The use of the SOF ordered set for Class 4 and the 
use of CS_CTLare unique to Class 4 and are not used by any 
Class 2 or Class 3 only compliant devices in Fibre Channel. 
[0125] Thus, embodiments of the present invention allow 
standard Class 2 and Class 3 devices to classify frames by 
utilizing the header fields that Class 2 and Class 3 use in 
normal operation. No changes to standard end devices oi 
NJflam are required to support QoS features. Within Fibre 
Channel Class 2 and Class 3, the only Crame header field 
conventionally used for routing or scheduling purposes is 
(he D ID field. The use of the other fields of the Fibre. 
Channel Header for routing andor scheduling to affect a 
QoS service is unique to embodiments of the present mvcii- 

[0126] Frame Queuing 

[0127] Afier the frame is classified, it is stored in an 
spp-.uc'hae aeusiiniling buffer (tpicue). As noted alx>ve. the 
s.v.tch may support any number of simultaneous QoS frac- 
tional circuits per input port. Each QoS fractional circuit lias 
an associated queue to hold frames awaiting scheduling for 
forwarding throtigh the. a ;'•■ ■'■ ontoa: port The structiuc 

and operation of the queue may vary from one embodiment 
to arothu. In one embodm;. m, the ;e;<eies ■■■ each input port 
arc very deep in order to allow a device lo bias! sequences 
of frames that may be quite large. These deep buffers serve 
the purpose re .ilteviaoae; heid-ot'-se-ttucrict ht-ako.:/ m a 
standard Fibre Channel class 2 or class 3 NIC card. 
[0.t2#] Buffer space for queues can be very expensive, 
particularly wr.e.r; nen-ory (or the queues its included in the 
design of an ASIC. The ASIC's valuable gates art consumed 
by the queues an:! the cos: 0 i' it.c o ; i- -v. ■■ v. ah ihei: 

size. Traditionally, system designers have minimized the 
number and size of buffers in their designs. In order to 
effectively guarantee fr;.e:».-.ma. binde, ielth ciic-.e'is, ii:,veevei, 
butlers are a necessity In fact, in one crabothrncm of the 
present invention, there are reasons for the use of large or 
"deep" buffers to improve the end-to-cttd QoS capability of 
the system. 
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[0129] II I >i iiitu !:j ckinj ccurswhet e ui woi 
data io be sen! from a port is blocked because there is a 
sequ. nee it fn tit of it in ihc qt < 1 < ii 4'' first to 
reduce cost, manufacturers of Fibre Channel Nj'oris have 
conventionally only included one transmit queue in their 
designs. These devices are then Unite J >\ their obituy io 
transmit only one sequence of data at a time. Once a 

juei e c.f data starts, il t i 

sequence can be transmitted. Therefore, if the currently 
active sequence is blocked by credit io its destination, no 
other secjuencu can be sent by the port until the currently 
active sequence events: ally finishes or times out as an error 
in transmission. 

[0130] Referring to FIG. 6. an exemplary host computer 
only has one transmit buffer. This buffer is organized as a 
tirsl-in-iirst-oiii queue, 'io alleviate (he bead of Queue block- 
ii r ii [midard i 2 id Cias 3 devices, one 
i icrn oi ths present invent! i i b-, orv i , 

buffers at rite h_PorJ of trie switch. 'She deep buffers of the 
switch are actually dynamically allocated from a very large 
buffer store, hi one embodiment, this is achieved by imple- 
menting ho; queues as linked lists. Once frames are classi- 
fied by the switch as, bfciag associated with a particular 
fractional circuit, buffer space ,s allocated from the buffer 
store to (ho appropriate dynamic queue (which is associated 
with the fractional circuit). The How control hack to the Host 
Computer is slmd rd Class 2 and Class 3 R RP it -based 
I h Or I t i i I i 

to K Ki i)i - in i i 



is larger than some multiple of the largest sequences likely 
St> be sent by the host computer. Ibis, allows the host 

tor to Iff tiei n e A'ttch f _l ! ort 

the line rale frames, fill the available buffers in lire b ! - :: 
at line rate on mi rite buffers are used. However, from the 
moment the firs! frame enters a Swiiely _ly_Port buffer it is 

ml i ui t the fine i it that match s its expected 

iwkiil '.ine \s esult, no r seqiienct hou.id 
go: stuck or blocked, and no subsequent, sequence should be 
held back. This essentially resells in a lenity bucket feeh- 
ruqiK to sole the icae b ,l i ir problem 

[ (H32 j It should be noted thai, in addition to she alleviation 

i i i J 1 1 i icing in n k dynai ' 
allocated queues provide more efficient use of buffer space 
than statically allocated queues and supports the use of 

e! eU I \ IKIe it , lit 1 e 

i t ail) f shun I tan eon j i hoi a i u 

it ' r • < , nay be al located , many, 

c fe t i ■ may irtmltK i 

i ic Dcej to i I , O | ml 

» i ) n i i 

he separated by long distances and yet still achieve masti- 
tis urn hue rate data efficiency. 

[0133] fh i in C totally allocated queues 

of the present switch are distinct from She rue chars isms of the 
prior art. For instance, devices such as host computers that 
are operable with Class 4 are expected to have n i Itipl 
tisa lrjuei hei that ic 1 igk a t used w Class 



la lass , 3-ope rah le cl ho-- 1 i pi 

Class 4 t 'ii queues ma 'On , peeitic 1 
tioiifci circuits. The Class 4 switch r i i actually puds 
frames from the M_Port it; the Class 4 bos! computer by 

i . fracti 
and, by association, ihc buffer from which to pull the frame. 
The switch T Port controls the number of frames that are 
pulled from i set of bull i Is the rate at 

which the frames are pulled, thereby controlling the band- 
width and latency of the homes for each circuit, it should be 

i e is to date no km m 

of Fibre Channel Class 4 switches or devices. 

[0134] Frame Scheduling 

[0135] After each frame is queried, it is scheduled for 
ransr n from the apj f j , t, 

and through the switching fabric In one embodiment, each 
QoS fractional circuit is scheduled independently of the 
ot hers, the rt h e r, e a ch Q o S fra ctao n al o, rcu it =3 a s an asso c i a led 
timer that determines when a frame is ready to come off the 
queue and be forwarded, 

[0136] After tite frames are classified and queued, they are 
..cffah.h d from the ptoper queues to enable d< U\. \ I Ik 
frames with the guarant c i I mch id hs (QoS). There are 
many methods for scheduling that may work, in one 
embodiment, ton i! 1 1 i 1 itbm is used. 

[0137] In accordance with ibis algorithm, every bandwidth 
rcservaiion is assumed to be tilled by the user by sending 
. gih fr ii e in ihe case oi Fibre Charm I a fu I i 
turn eposes 2 Kbytes of data. If 1 Megabyte per t 
is tie gu rant d id \ ito six) lie c ate 
i t t i ! I 

must }>e sent. For instance, m this 1. Megabyte per second 
fractional. circuit, frames must be sen; at a 2 millisecond rale 
in order to stay current with the overall bandwidth rate. The 
2 millisecond rale window is computet) by dividing the 
number o pack is tutu ' second O. !'.i0~0,ff02 em , 
f! 1 i 1 ikes the least common decon ii ito > ill 
the requested bandwidth reservations and comes up with a. 
common rale window dunrtg which a number of frames 
must be sent for each circuit. 

[0138] As an example, if it is assumed that there is a 2 
'1 bytt Croud in lddi ion Io hie t Megabyte circuit, the 

t i nina ndwkfth ra 

is 1/500, or 2 milliseconds. The rate window is therefore 2 
milliseconds. Accordingly, the i. Megabyte per second cir- 
cuit will have one frame scheduled per rate window, and the 
a r remit will have 2 im t 1 

per tale window. The rate window of 2 milliseconds will 
iv ippi " iy 20 frame lime onset , threi ! 
the frames thai can be sent during the rate window ate 
reserved for the queues corresponding to the fractional 
it 1 i rites i n I- idlf 1 I ' ' r 

i \ Hie other 17 frame (in 

dynamically schedule all other available frames. 

[0139] it Should be noted that, in this embodiment, frames 
it i i id node ti 

and may be arriving much faster than the. antieipaied and 
i i ■ i ha iicft. tl a buffer d 

not c ,1 i i - > 1 mrh r hcduling purpo.s 
until the court < 1 
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i n . i iii. I, ji t 

sw but there are .8 frames in the queue, those frames 
1 i i i j i is irss U v< u'j 

ore sake four rate windows tc» send all eight frames. 



c jor tb m eh »Kl 

n J ' 1 ^ > 

,i >. s l in > > 1 

window has opened. 

[0141] In one embodiment, each frame also has an asso- 
i i i thin i 'i ■ , i .i c s i< i 1 . I e n 
associated with a specific virtual circuit, and the window in 
which the frame is to he forwarded has arrived, a clock time 
is associated wiUi the frame. 1'his is the expiry lime. The 
expiry time is ihc time the frame needs to have been 
forwarded in order to meet its QoS circuit t latency or 
b lib) reiumr T i ,cra ten! tin fibi.it 

t rubra am ues ill t u que i >r a speci d hoi 
i! r fra !!< s ivusrkcd is le il li !e to □ w trcl If 
multiple queues corresponding to rnuUtpIe circuits have 
frames which are ready Ha forward lo the same destination, 
the bin filling iilgeriiJiw. selects the one with the nearest 
expiry time first. In (his manner, the expiry time is used to 
prioritize handling of frames. 

[0142] In regard to flow control, frames set sent from a 

1 I i l 1 t ! 1 1 ' 

1 0 u I ('ill 

a stj ira i r e ] r L ^r [ s i l i it. 1 

way, a fractional circuit should never be blocked for credh 
because oi tC po r perl nai f ; siher circuit. 

[01.43] Fire classification qn uemij nil Sche lir 

t ibove i hi the h i i 1 iny i ! 'he 

frames in a manner that ailows quality of service guarantees 
to he provided, in other words, they describe the function- 

lily of th tches used i )oS 1 re ' i 

class 2 and class 3 devices. It is also important to address the 
end-to-end characteristics of the system in relation to pro- 
viding QoS guarantees (e.g., minimum bandwkllb and roaKt- 
i ; Mi 'I ■, u " i cl r bran 

1 i i j — I J r l 

it-' i i of t wild iuables in cm to . rid 

pioioc i nd it i q lie kins 

[0144] Circuit Setup/Teardowa 

[til 45] The user needs to have an end-to-emf circuit set up 
i ire i ci .1 m :M to bin hi I flit 

j > i it' i I i i 

if most oi th. circuit is opera tit j id« fth i be present 

s till 1 I 

QoS quirements ml > i <> . , .-fort aci ml 

circuits me ai'too ■ id C 5 g' nlees are made. 

i! to | | , the present circuit 

on the 1 SIT datab se for it ' . 1 f I 

i i t s) and then m no ins i is vn ( s dal 

< 1 1 1 ' ■ 1 it*! 1 j 

i lis in bnc. Acirci 

setup ties! i oes El QoS-enabled 1 ■ 



Wich along foe path it ' i 1 be me 
i . tv to hai he reiser it tch in th 

8 PI h cannot hand! bandwid inn then the 

switch will automatically investigate all alternative routes to 
iinil one h i v i I I i rescrva i 

[0147] A request to set up a circuit can come from any 
switch element in the fabric. This request is broadcast to all 
oi the switch elements. Each swjfcb then determines 
whether it ism the best path, and whether it has the resources 
set l i i 1 i li I 

can handle the circuit, the circuit is set up. If the switch 

laments in I si p nn> lamJte tin r Uit altera ■ 
live rout s ar t selected "aci lS,v orics d i switch eb 
incuts again determine whether they can support the pro- 
V s d circuit. If the circuit can be handled, it is set up and 

oti ication i f the new circuit is broadcast to ail of for: 
itches. Is should be not t i 'in 

of tb roust routing cat 1 a lapl . o t - ; 1 - 

in the event that congestion no ct i'aihii o other condi- 
tions prevent the existing circuit from meeting its QoS 
requirements. 

[«I4X] Switches that are not QiiS-eiiabied are not sent the 
request and an; not considered active participants. A switch 
that does not actively participate in QoS may still be in ihc 
Q s 1 i vcvei ti he data paths into thai swi eh m 
in fact controlled by QoS-enabled switches The QoS- 

bietlswitc.l to i I i I 

not overly taxed. It is there! < o > 

hetcrog us envircnin c"< r . ncnt in ucli 

not all of th switch i i i ' I'^t In n om 

manner, a few element: ili ired it rdance with the 
j a n i 1 nt i > i 



is of a 



ritcbm 



. ,-erl mile 



i^estbftbe present sj 



met beds 



Consider, for c: 



[0149] IT 

are apparent in comparison to poor art systems, none ot 
which matches the present end-to-end QoS capabilities, 
theme!. Line/net uses a reservation 
r discover eiiiTto-cnd behavior in 
support of QoS at cverv bore RSVP relies on two signaling 
PA1 1 RSVP. 1 G'K i.mar row 

die source along the shortest path first route which is 
cmrontlv established. At each hop, the cut rent network 
i element/; . a tbe PATH 1 

lie lSiion denornh 



QoS scheduling and ban 
RSVP messages thai inc 
QoS handling available , 



ion sends back 



actual! j 



f'lls> Orel it pr 

the I xi e n t r t ' x isur Kit 1 bad 

ward path is exactly tbe same as ib.e forward path. This 
i ption ts not correct i r Fib han.nel Co If PIG. 
, . n I tunnel FSPF (Fabi I *at 

) u V[- tssatnt th t only one nub will exist is the 
shortest path at a given time between two endpotnts (e.g., 
ii . ( i RSV'l Jnc l ■ tath 

li exist 

th verse direct a fi en nodi i t nodt A ir bbbn 
Chat i i ili econd p itt has tnc sain I 

associated with it as the first path, it is very possible for 
frames to transit the first path from node A to node C, and 
to transit the second" path from node C to node A. Such 
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occurrences are common in Fibre Channel because it is 
common practice to have more than one eofwsccliou arid path 
lo a critical server. 

[0151] Another problem is thai, in order for RSVP to work 
propei lv, the entire switch fabric, must be able to node island 
RSVP. Jo other words the fabric mast be homogeneous with 

mpieuienl prole 
even it" no! on ability to .actually handle frames equally across 
the network. 

[01S2] Another difference between the NGS circuit setup 
and RSVP .is thai the developers of KSVP choose to make il 
independent of the routine, protocol. This is accomplished by 

i; the c i r i i e i e in 

protocol g 'he - < w xnaiii illy dotcrms it network 

... j] t f 1 , . ' i. 

information th t i i i ii luring network initial- 
ization. '.Hit; result is thai the prcsenl switches know -what 
other network elements are in place and io whom they 
belong. As a result, when a port of the present switch desires 
to set up a guaranteed fractional circuit, ii sends die setup 




0153 h i in . . h r , ' I , 

la tnotii 1 i 

mdwidih< ' tort m t 

t ; t e ! ! 

fractional circuit is dismantled, the immes between the two 
end devices for dm circuit arc handled using standard 
ioi iction i e Cha tmel Chess 2 ani 

i -, *r i! > , i j r livery i > i 1 

able bandwidth 

[Ols^j in i e embodiment of h i i 
•QoS circu.it is torn flown by closing the circuit on ihe switch 
closest io the source first. In other words, the switch i» 
t th i tl circuit is ing t 1 1 remit s then 
cd fin 'i tf next, and 

on, until th> x swt hisrea her i) dswit be 

in the fabric arc aiso niHiActi nf the circuit t i hat 
their QoS databases can be updated. 

[0156] St should be noted that, in one embodiment, when 
the circuit is io be closed at a switch, the frames in the queue 
for the circuit must first he cleaned up. This is done by 
et [ Of frames in! le ij em 1 < 

circuit, then waiting for ihe frames in the queue io be 
retrieved aotl forwarded. When the queue is empty, ihe 
circuit can be closed. This is repeated for each successive 
switch tu t ' < > sniani i'the fram st.hat ate 

accepted in tiw eaten it ate delivered before the circuit is 
completely closed. 

[SU57] Advantages 

•h 58] o id u t , over ihe pri at 1 

obtained ay the various embodiments of -the present invett- 
o. Sora tl i i it w> " air ! 



t 1 i 111 1 

l i I t i I { 1 d 

with circuits that have associates:! latency and bandwidth 
t nice ■'■ ipleraenrin he pa en yysti ■ and i th 
oris iu a Fibre Charmed swiiehir._ fabric. Ctassification of 
' i t i i ' ui s bused cm noivQoS 

infeurnawon (e.g., S_ID, DJD'l in standard frame headers. 

Mil ( I 

diiicalion f lilt, tievices heinselves is aeess j to 
achieve the latency and bandwidth guarantees, which are 

i ,i ol nl Fibre Channel Class 4 serviet 
[0159] Another advantage of some embodiments is the use 

1 | i l i l vo fram i ha 

Hi!'! , i i 1 1 J 

ins switches 1 1 1 

' e one or more received ft in have 

not yet been p el ii rid lorwa tied to appi > 

priatc queues. Instead, the switches can be her a large 
nnmbei 1' frame ( j burs trallic) ilh i ej 

and then allow ihe frames to be processed more slowly, 
ileaa-of-rjucue blocking is thereby avaitted. 
[01 f>«] w .it > i , v lentsislheo 
of dynamically allocated queries to hold ihe classified 

ne.s As di,.,cttsS.:d a! i k 

from a pool of buffer spaC c. Queues can be allocated when 
a CTirtespondiiig QoS circuit is set up, and deallocated when 
the Circuit is tort; down. As frames are received and ckosso 
hud, queue- foi he correspond t ti as can be 

i re 1 < I t i r t is s , < t i I 

done in one emb di I I 

1 ' io t tie queues, corn 

ii le i i i 1 I < i t I I 
dynamic allocation oi the queues provides much more 

ciSoieut < ...a: of the duller space than statically allocated 

tj^i i i tape that may bt provided by 

embodiments of this iiivesition is the support of hetcroge- 

I i . o 

I ne, I i provided in e-itvi.r n ts wh ic not 

all thi switches pi et i uppon m method -of pro' ling 
QoS. By comparison, Fibre < is h has not 

eo irepk lent d) paires iha witch p •« t 
ire Fibre Channel fa! p; t i 

por cm a e it Linen t S techmq flea itia! Ser- 

vices, Integmied Services and MPLS, or Multi-Protocol. 
1 abel Switching) require asi endoo-cud .setup protocol called 
i > h every hop a he h tiding pa . QoS 
onsistencY. RSVP, however, a - f I return routing 
path lor a circuit will he the same as the forward waning 
path, which is not (rue in Fibre Channel. RSVP is also 

,11s, i 

from the network routing database. The present systems and 

too rn paths ar il 

the same as forwarding paths and make use of tile Fibre 
Channel network database for additional touting informa- 
tion, like end result is that ihe present systems and methods 
do not re p i i t i bility t oil r 

guaranteed fractional bandwidth services, hi other words, 
isot all of the switches must provide the same QoS capa- 
ble s. 1 r e^ | systems d meil may th efot 
implemented in a heterogeneous network environment. 
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f .l'2 \ hit id an i that may be pi videi by 
lonls of M ii ot systems and thuds relates I 
i > hb i o< ii « i pi ior art system fid m 
d\\ i I'ii .vlti is Uoealed i circuit bin : t used , i 
in the present systems ami methods, unused bandwidth on a 
id; is [jyu lly ar a I ilable f< ' 

traittc. The unused bandwidth may simply be unallocated 
li ni d that ar tititiy 

utilizing die bandwidth. Either way, the unused portion of 
ht in be used b ie sa nu two devices «>r other 
( iii ccivc dai i i 1 

tin! Class 3 frames i Gmtiantecti >a Iwi. ti hi. , .S. us iiiiv 
he modified in real-time, thereby allowing circuits to be 
managed in a dvnamic environment. For instance, it maybe 
,i i . n t > 

operation have their bandwidth allocations temporarily 
lite wa -restore i i\ j t altoealiorcs I be ct / i i 



[0163] Yet another advantage that may be provided by 
i ', i i his inventi il i ' \ r switch 
to route Qt in ' i rotia tiling 1 

nkpres. This can be aecaampHxhed for QoS frames allocated 
to fraction a c nit t. ' a i i utilization In prior art 
technologies such as Ethernet, attempts to provide QoS 
t 1 v ' > t adds significantly I 

the latency of the routed frames. 

[01fa4] Bod Id rl W idaf ie in in \] s 
]01o )J \s noted above, that re see ,1 appl i 
lie ir tie Fibre Channel set of standard tb.it are 
■ . t I he tone Fhest i it ! t d- < ! ne Fibr t innel 
Classes .1-4, 6 and I : . The identified Fibre Channe! standards 
specify a variety of cmnmtiidcation protocols, dm a rates and 

es (e g., optical, coaxi a . tv « 
mm wires) tor interconnecting ami communicating between 
peripheral devices, network devices and switches, and com- 
puting devices that support multiple I/O and networking 
protocols, 

[11166] I ht Inlet i r Information Tech 

(Ir-. Ms re , »ifS 

i i r i ft oat ! jd is 

iii INCH'S si - 1 n 1 JKMATiO. 

' ' i . ! .bid t| \n;si t ia Sit j VND 

SlGNALLlNt < i hi v L (FC-Eii; ANSI x I TS 
X3.230-19M (hereafter "FC-PH"), which is incorporated 
herein by reference 

[01 6" J \n idenchi to E< PH has beet i< Med c 
vailabk is INCH'S standard documen! E Nil TIED 

ADULNLHIM 1 lO ANSI, Nf US \T- EM) VK. i h.RE 

iA CPU ' f 1 LUNG J lU'At 

f'i -I'll) \NSJ/NCITS X3.23 m A id> Mm 
i teaftej p( Ml) which is incorporated herein by 



1 >' 1 I i 'It 1 

1 I V. ii S s' , . i I i " x Id N M 

2 TO ANSJ/NC1TS X3. 230-1994, FIBRE CHANNEL. 
PI! 1CAL AN -• • Lf.ING 1NTEI CI ( HI) 
VNS) Mil 3.23 1 Ad tend! r, i lm)6 (hereafts 

"FC-PH-2-"). v. t ted .er^ h\ t< ti ice. 



01 v . > . 1 < - i • 

hi 1N< 1 larulardd n t EN'l'lTi D FIB El 
CI I ANNE I D Gl RATION ( HI > ! vli \ 

(( h ANSI CFS - 17-19 7 (her. arte hi PH », 
winch is incorporated herein by reference. 
[1)170] A second supplement to FC-PH has been adopted 
and is vaik 1« is INe ITS stand a 
,i 1 > [ {ON FIBRE CHANNEL PHYSI 

I INGI ERFACE ( C I, ANSI/1 ' 

< bei U PH V>, fthtih is uleO pn alcvi 

[0171] A separate standard in the set of Fibre Channe! 
h is b i adorned ai . ivatiablc fNCFIUi 

a i ERE C1.1ANN EL — LAB I 

GENERI REQUIREM NT'S fj ( FG) \NS1 b 

X3.2S9-W96 (hereafter "PC-EG"), which is incorporated 
hereui by reference. 

[0172] A modification and replacement for FC-SW-i is in 
i l i m f e j s i iv(M i !\ 

m . !\FORMAUON Ste< HN.n 

OGY — FIBRE CHANNEL SWITCH FABRiC—2 (ITT 
SW-2), ANSI/NCFi'S 355-2001 (hereafter "FC-SW-2"), 
which is incorporated herein by reference. 

[0173] Classes of Service Available 

[0174] As pointed out above. Fibre Channel supports six 
different Classes of Service for delivering, or attempting So 
ieliver info nation frames between mmuaicat ng devices 
and/or switches and through switches in a system (i.e., 
Classes of Service 1-4, 6 and Ej. The highlights of these 
classes of service are described below. 
[0175] Class 1 

Him) Class 1 is a nser class of service; meaning, it is 

crd ; across the network. When Hi 
pi L a mi t l c crL 1 

me si r ] [ i C li I e I i ft I t r 

con; sts >l » (ir cat. • < > irca roni tht first device 

to the second device and a second dedicated real circuit from 
the econd device to the firs device I'best two dec! 
real circuits form a bi-directional path lor information 
rai'if i i v i i lirst device art.:; !fi sccon I device, f-tn 
Class 1, the firs! device ami [he second device arc active 
riii pact m setting up tie dedicah I connection >; 
rec|cessit!S the dedicated comwxtion of the switches) 
between fbena. 

[0177] In Class 1, one hundred percent (U>0«) of the 
it ii i d It a in each of the i 

! Oil \ l| I i 

In addition, the maximum latency across ilae switched fabric 
is guaranteed, hit known, beh he I ■ ' 

• f the pr s « it t 

(10 I dedic I real i ndwidth n each dedicated real 
ciicnii is that the first and second devices, as weil as the 

it < n i , i i i < > i 

perci it (100 { ' i - dthin .no t transfers tr the other, 
even for short periods of time, lite result is a loss of 
illocated bandwidth t i the « mtimnieati >n syst -m, since the 
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1 1 1 [i cat i o i 

reallocated to other tie vices. A problem with die unknown 
maximum latency across the switched fabric is thai, 
although delivery of ua information frame between the 
devices is guaranteed, neither She first device nor the second 
device l in t t! 



It tilt 



afta 



witches 



.okmv 



, Class o 



device through ai feast one switch with the at least one 
. !* t mutiip!. o g fra n it ! n u >und - cross each 
Si least orie switch, bite receiving device provides an 
i. nowlcdgineut ( ACK) fbusyfPj t >} use tot In 
cry of .tor information frame by sending an ACK or P_BSY 

i , i t ,i frame aack u 1 smlu^ tfevic or ihc 

I t i i Ji i ilui 1 

information frame by sending a fabric busy (l-CliSY) infor- 
mation IVame back to ibc sending device. For Claris 2. no 
bandwidth (it ) s allocated ay guaranteed to either the first 
device or the second device through at least one switch. 
n»cns are no dedicated fractional circuits or dedicated 
virtual circuits between die lirst device and the second 
device through at least one switch bite path used across the 
switched fabric may change on frame boundaries. Tibs 
means that no dedicated or virtual path exists between the 
first device and the second device and there is no minimum 
tu in i I o C , h In oldiiion M ass 2 titer i n 



! tat: 



t bat 



iely 



[ftlSO] Mas! switches on the roirVtei od uppc.rt < 
i.-. arc utilizing it 



[lli.S'2] Whet 



tched fabric t( 
onnechontcss 



logy is 



ii hi i ith 

the at e ,si mc switch r t| sing frames a mi 
boundaries across each a! least one switch. The receiving 
device cities not provide any acknowledgment or busy 
response to deliver} >£ an inform i i 1, afe te 

switched fabric tines not provide notification of failure to 
deliver an information frame. This type of information 
transfer is called a datagram service in networks. For Class 
3, like C! s ~,nt hid, ih(0 * ' sated r guaranteed 
to either the first device or tin -re nd tkvroc ! here ire no 
i cuifc rd ten s ttaal r ui bet eeri 

the first device and the second device through at leasl one 
path usee! .ic the switched i ri< a • hai y 
t tr ni i id in s tin no i i od or virtual 

path exists between the first device and the second device 
and no minimum mooot bandwidth In addition for 

s ? i t 1 1 ccd la ; c t 

switched fabric. Class 3 operation is completely asynchro- 
nous and imb render in one. wti rs uccesstirj on te d time 
operations (e ^ , video im demand) 



ft)!N3] Class 3 is a user class of service and is the 
! i ni ent class if -us ct at esc ir the t arket place todit) 
[0184] Class 4 

[01.S5] When the switched fabric topology is in use. Class 
of Service 4 establishes a virtual circuit connection between 
a first device and a second device through al least one 
switch: the fabric retains the virtual circuit connection . A 
virtual circuit connection consists of a thus dedicated virtual 
circuit 1 from a first device to a second device through at 
1 ; m « s ell. Additionally, a ded itedvirl corn lion 



is.sofa 



rond ah 



J a), least one switch, dlaese 
St t di li d t I n nis t ni i h iunil i le 

m hit tf r: a let brough at— kasr one switc! S oi t lass 4, 
[he first device ntd !,,. on i levict re ,cti pai i 
n - (ting up the Class 4 virt al circuits hi t he 4 souk 
am ni ofl ndwidti tip t n« htradrc p-ms,. at i i I ) 
i i i i 1 i i 

!i d nit, i cits ii ts hi i kht on, the maxin m 
5 i s i - i t ' i ■ n' i i r i 
between die lirst and second devices through at least one 

[01S6] Class 4 is a user class of service. Although highly 
desirable to support real time or metered delivery applica- 

t - lera with Class 4 is that it is wn clepl 
any device or switch manufacturer; ii is jus: a concent with 
.special i -o tiremems that tie not compatible with presently 
deployed devices or switches. 

[01.87] Some issues with Class 4 in regards to deployed 
fibre i h limit switches ui j an. Class 2 and Class 3 in 
unique start of frame delimiters lhat no one generates or 
>e> m hard t o ■' , > i > i o C tut eh, 

all ports in the system; both the cod node devices as well as 
switch o irts io implement tin i s 4 . (il any port 
does not support class 4 no application may use it); the 
end-to-end setup protocol as defined in the standard is 
incorrect „ r broken' and will not work Come engineers claim 
thai CI as 4 itself can < aik ir a praeli t! s\ stern) 

[01«S] Class 6 

[0189] Class of Service 6 is a dedicated connection service 
that suppo is multicast op ratio! ui one iifoi i 
frame Irom one device sew to a plurality oi second devices). 
Class of Service 6 shares the same attributes as Class 1 
above In fact. Class 6 oai! o lition of ri liable 

multicast feature for Class .1. 
[0190] Class T 

[0191] Class of Service b is a connectionless service that 
is restricted to use only by switches (it is not a user class of 
service), when com miinicaling with each other. Class of 
Service F sf s the s , t itesasCi s2 n.w, bid it 
is restricted t tsi >nly vithin ! tween switches 

[0192] The benefits and advantages which may be pro- 
v ced j- 'he ptc^nt invention hav- been described above 
^ 1 i i amis! ,i 

advantages, and any elements or limitations that may cause 
litem to occur or In become more pronounced are not io lie 
construed as critical, required, or essential features of any or 
all of the claims. As used herein, the terms 'comprises. 
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"comprising/ or any other variiiticn* thetso., «? intended 
to be iotetpreled .is non-exelustvely including 'die e.»:?.tc:n$ 
or limitations which follow those terms. Accordingly, a 
system, method, or o-he uKbodime f e, i fiscstiSetol 
elements is not limited to only those elements, and may 
include other elements not expressly listed or inherent to the 
claimed embodiment. 

[019S\ While the present invention tm been described 
with reference to p.unc:!h..- •.rmsmme-.us. it should be 
understood lb.it the cmbodim-ariis arc illustrative and that Ihe 
scope of the invention i.s not limited to these embodiments. 
Many variations, modifications, additions and improve- 
ments to she embodiments described above are possible. It 
i.s contemplated llm these variations, mod it: cations, addi- 
tions and improvement:-, fail within the scopt of the inven- 
tion »•> detailed within the billow -.ne, claims. 

What is claimed is: 

1. A method comprising; 

receiving one or more frames, wherein each frame con- 
tains non-Quality-of-Service (non-QoS) header infor- 
mation; 

classifying the one or more frames based on the corre- 
sponding non-QoS header information; and 

schcduliag delivery of the one or more frames based upon 
corresponding frame classifications, wherein frames in 
classifications corresponding to Quality-of-Service 
(QoS) circuits are scheduled in a manner that meets 
QoS requirements associated with the QoS circuits. 

2. The method of claim I . wherein the one or more, frames 

3. The method of claim 2, wherein the one or more frames 
comprise Fibre Channel Class. 2 or Class 3 frames. 

4. The method of claim i, further comprising storing each 
of the one or more bamcs in .« queue, wherein '.he queue ;s 
Selected based upon ttie classification of (be frame. 

5. She method of claim 1, funhci ....••!:•- -am: o'efmim; 
header infoiiiwilion criteria cone.spontliiig w one or more 
QoS circuits, wherein classifying the one or more frames 
comprises identifying ones of the frames for which the 
eorresjM»R<!it>si bcedei h:f imatio;; meets hie defined eritctta. 

f>. The method of claim 5, fmlbcr compnsfr-g a|i.:-c;.!ii»tj a 
queue for each of (he defined QoS eiteuhs from a pool of 
: i>siifi.r space and storing :*t antes classified as cm: e m:o:jc '.;.'!.'. 
to each QoS circuit ai coo-espomhr-,;-. queue. 

7. The method of claim 6, wherein buffer space is dynami- 
cally allocated to each queue as needed to store the corre- 
sponding frames. 

8. The method of claim 5, further comprising deallocating 
at least one of the QoS circuits by successively notifying 
each switch in the path of the at least one QoS circuit that 
the at least one QoS circuit is deallocated, beginning wf.fc a 
wmcb .i.,.:,-e.-s -.ource m-o'e a::c eliding with switch 

9 The method of claim 8, further comprising notifying 
:-dditi."!.. vAif.-iws bin; supper. QoS in a ciuTcsiiortdirig 
switching fabric that the at leas; one OoS circuit is deiJuv- 

1.0. "fhe method of claim 1, wherein the method is 
implemented in a switching fV>rk ..tie wherein the method 
further comprises identifying a level of QoS supported by 
each switch in the switching fabric. 



U» The method of claim 10, wherein information identi- 
fying the level of QoS supported by each switch in ihe 
switching fabric is communicated to each of the switches 
tint si poor: QoS 

12. The method of claim .1, wherein the one or mote 
frames are .scheduled icc-Kdair. :•: a laai.hc. i-m idling 
algorithm in which bins corresponding to each of one or 
more QoS classifications are (tiled, first with frames having 
itie classifications of the correspond ing bins, and then with 
frames having other classifications 

13. A system eompiisittg: 
one or more input ports, 
one or more output ports; 
one or mote queues; and 

a processor coupled to the. input ports, the output ports and 
the queues; 

wherein the processor is configured to 

examine non-Q tia I it v-o f-Sct vice (noti-QoS) headers of 
frames received at the input ports, 

classify the frames based on corresponding non-QoS 
header information, and schedule transmission of ihe 
frames based on the respective classifications of the 
frames from the output pons. 

14. The system of claim .13, further comprising one or 
more queues, wherein each queue corresponds to a frame 
massif nation, and wherein each frame is stored in a queue 
corresponding to the classification of the frame. 

15. The system of claim 14, further comprising a decision 
buffer, where:.'! the processor is configured to store each 
frame itl the decision buffer, to examine the header infor- 
mation of the frame and classify the frame while the frame 
is stored in the decision buiicr, and to forward the frame 
from ihe decision, buffer So queue t.orrcspondiijg to U* 
classification of the frame. 

17. The system of claim 16, wherein the system is 
configured to process Fibre Channel Class 2 or' Class 3 
frames. 

18. The system of claim 13, wherein the processor is 
coBik'urcd to d> mm sadly ,«ti htiifcf *f..ce to the one oi 
more queues from a buffer poof. 

19. The system of claim IS, wherein the processor is 
configured to implement the queues as linked lists. 

20. 'Hie system of claim 13, wherein ihe system is one of 
a plurality of switches in a switching fabric and wherein the 
processor is configured to maintain information identifying 
levels of Quality-of-Service (QoS) supported by one or mote 
additional switches in the switching fabric. 

21. The system of claim 1.3, wherein the processor is 
configured to schedule the frames according to a modified 
h-m-mlxe aiuorithri- in which birr, n.-.-rt -so. mbrv. :;■ each ot 
one or morcQoS cb«Sf.c3t.ons are Ailed, first with frames 
having the classifications of the err responding bins, and 
then with frames having other classifications. 

22. The system of claim 13, further comprising a deep 
bufler , mum. mb. to receive ill;: frames from trie mr.'.ii pons, 
wherein the deep buffer is configured to store bursts of 
frames without blocking receipt of additional frames. 
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23. The system ofclairo B, wherein the symrx ora i 

a plurality 'of switches, each of which is eoa.ftg.ured in 
accordance wiih ctairn Ire 

24. The system of claim 23. wherein the plurality of 
.twrtcdes provide homogeneous levels of QoS capabilities. 

25. The system t if claim 23, wherein the plurality of 
switches provide heterogeneous levels of QoS capabilities. 

26. The .system of chum 23. wherein the plurality of 
vitch r k , t . o.s j a hi! it 



Jel eryof'f Channel >s.s 2 or Class, 3 frames between 
legacy Fibre Channel Class 2 or Class 3 devices. 

2?. The system of claim 23, wherein hi response to one oil 
> .s oaqiiestina: a QoS cii ch i rote} 

clcttrrmst'O; whether the switch is in a best path and whether 
the switch has the resources to set up the QoS circuit. 



